There Is No Preview Available For This Item

This item does not appear to have any files that can be experienced on Archive.org.
Please download files in this item to interact with them on your computer.
Show all files

GeoCities Web Archive Collection Derivatives

by: Nick Ruest

Publication date: 2022-11-19
Usage: Attribution 4.0 International
Topics: csv, apache spark, geocities, web archives, archives unleashed, sparkling
Item Size: 738.6G

Web archive derivatives of the GeoCities collection from the Internet Archive (v3).

The derivatives were created with the Archives Unleashed Toolkit 1.2.0, and align with the derivatives produced by Archives Research Compute Hub (ARCH).

This updated dataset includes last_modified_date columns for a number of the derivatives, as well YYYYMMDD crawl_date format for the domain graph.

The CSV derivatives include:

Domain frequency
- domain
- count
Domain graph
- crawl_date
- source
- target
- count
Image graph
- crawl_date
- source
- url
- alt_text
Web graph
- crawl_date
- source
- target
- anchor_text
Binary information
- Audio, pdf, spreadsheet, powerpoint, video, word
  - crawl_date
  - last_date_modified
  - url
  - filename
  - extension
  - mime_type_web_server
  - mime_type_tika
  - md5
  - sha1
- Image
  - crawl_date
  - last_date_modified
  - url
  - filename
  - extension
  - mime_type_web_server
  - mime_type_tika
  - width
  - height
  - md5
  - sha1
Text files (css, html, js, json, plain text, xml) information
- crawl_date
- last_date_modified
- url
- filename
- extension
- mime_type_web_server
- mime_type_tika
- md5
- sha1
- content

For more information on how the Archives Unleashed Toolkit was used to produce the derivatives, please see the Archives Unleashed Toolkit documentation.

Addeddate: 2021-01-08 13:47:49
Identifier: geocities-webarchive-collection-derivatives
Scanner: Internet Archive Python library 1.9.6
Year: 2022